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Group comparisons for male, female, majority, and minority students 
were conducted for the Test of Standard Written English (TSWE) . Data foi 
two academic years and from 18 different institutions were analyzed by 
pooling data across institutions within each of the academic years. 
Analyses of data from the first academic year focused on relationships 
between TSWE scores and grades. Analyses of the' second academic year 
focused on relationships between TSWE scores and scores on graded writing 
samples. No important group differences in traditional correlational 
analyses for either grade or essay prediction were observed. No important 
group differences were observed in either correlational analyses or regres- 
sion analyses of the second year essay data. Analyses of correct and 
incorrect placement decisions (hits and misses) at specific TSWE cut-off 
scores revealed no noteworthy group differences whether outcomes were 
based Dn English course grades or on f reshmai^i/year writing performance. 
Whether grades or essays were uJed as the outcome, the proportion of 
incorrect decisions (misses) was less for minority students than for any 
of the groups. For all groups, the TSWE appeared to predict freshman year 
writing performance as well as or better than pre-course writing samples, 
high school English grades, or high school ranlc in class. 
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Introduction 

Th^ Test of Standard Written English (TSWE) is a 30-minute multiple- 
choice examination that assesses the abilicy ta^use the conventions of 
standard written English. . The TSWE was* introduced, on an experimental 

it 

basis, in 1974 as a part of the Admissions Testing Program (ATP) of the 
College Entrance Examination Board. The ATP includes the Scholastic 
. Aptitude Test (SAT), achievement tests in 14 subjects, and the Student 
Descriptive Questionnaire (SDQ) . In 1977 the TSWE will become a perman- 
ent part of the ATP. offered along with the SAT, but it will* also be 
available to colleges for separate use. 

During the 1974-75 and 1975-76 academic years a total of 18 
colleges collaborated with Educational Testing Service in two studies of 
the TSWE. Fourteen colleges participated the first year and four the 
second. These colleges are described by type and location in the table 
on the next, page. General results of the first; year study were reported 
in Breland, Conlan, and Rogosa (1976) and general res^dlts of the second 
year study in Breland (1977). This report describes special group com- 
parisons made for both the first year and th.e second year studies. The 
previous two reports, however, provide the details of data collection 
and descriptions of the variables employed. 

Because of the Small numbers of subjects that result from the sub- 
division of samples within colleges, all data within each of the two 
groups of colleges were pooled. That is, the 1974-75 data frcm| four teen 
colleges formed ^ne group and the 1975-76 data from four colleges formed 
a second group. With the larger numbers of cases thus^ available for the 
two sets, it was then possible to subdivide each of the sets by sex and 
ethnic identification. Even so, the srall number of available minority 
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Descriptions of Institutions 



Data College 
Collection Code 



Summary Description 



Region Location 



1974-75 



1975-76 



A Two-year public comprehensive 

community junior college 

B Four-year public university 

C Two-year public community 

college 

D Four-year Catholic University 

E Four-year public college of 

arts and science 

F Four-year private college 

G Four-year public liberal arts 

teachers college 

H Four-year public college of 

arts and science 

I Two-year public Junior college 

y J Four-year public multipurpose 

college 

K Four-year Catholic university 

L Four-year Public university 

M Four-year private nonsec- 

tarian liberal arts college 

N ' Four-year public teachers' 
college 

P Four-year public university 



Q Four-year college of engi- 

neering and technplogy for 
men and women 

R Four-year public university 

for men and women^ 

'S Four-year private nonsecr 

tarian university for 
men and women 



Southwest Urban 

Far West Urban 

Far West Small town' 

Far West Suburban 

Southeast Small city 

Northeast Small city 

Southeast Small city 

Northeast Small town 

Northeast Urban 

Northeast Suburban 

Midwest Suburban 

Southeast Urban 

Far West Suburban 

Northeast Small City 

Southeast Suburban 
Communi ty 

Northeast Metropolitan 
Area 

Southeast Small town 

Nor theas t Me tr op o li tan 
Area 



Note: College 0 was not included in the analysis of this report because 
data for College 0 were not easily combined with data for the 
other colleges. 
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students required that only the classifications of "majority" and 
"minority" be used. ^Minoritieb were identified as those students de- 
scribing themselves as American Indian, Black or Afro-American or Negro, 
Mexican-American or Chicano, 0?:iental or Asian- American, or Puerto Rican. 
Students describing themselves as White, Caucasian, or "other" were 
classified as majorities. 

Since the kinds of analyses possible were slightly different for 
the two data sets, the results are presented in two parts. Part * 
reports the results of analyses of data from the 14. colleges that 
participated during the 1974775 academic year. Part II reports results 
for the four colleges ijy the 1975-76 study.* The Part I analyses used 
course grades as a criterion, while in Part II, a unique criterion of 
student performance was available — actual writing samples. Writing 
samples were collected at three different times during the 1975-76 
academic year. Each of these writing samples was then scored, independently, 
by two different experienced essay readers. The readers did not know from 
what college the essay came, when it was written, or the ethnic identi- 
fication of the student. However, the writing sample did contain the 
student's name and 'identification of the sex of the student. 
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Part I: Croup Comparisons for the 
1974-75 Data Set 

A total of almost 7,000 students in 14 colleges provided data 
during the 1974-75 academic year. This total included- 3,081 males, 
3,627 females, 4,053 majorities and 888 rainori'ties. The 83§ minorities 
consisted of 43 .American Indians, 456 Blacks, 206 Mexican-Americans, 
158 Asian-Americans, and 25 Puerto Ricans. For each of the four inajor 
groups, analyses of 3 types were conducted: (1) comparisons of bivariate 
distributions of TSWE scores and course grades, (2) comparisons of 
instructional placements by TSWE scores, and (3) comparisons of the 
correlations of TSWE scores with all other available data. 

. / • 

* * - 

Comparisons of Distributions 

Tables 1, 2, 3, and 4 present comparisons of freshman English 

course grades as a. function of the TSWE score range. (Thf*se TSWE scores 

wore obtained in, special administrations of the TSWE, conducted by the 

participating institutions). At the top of each table are shown the 

numbers of students obtaining certain course grades and at the bottom 

oi each table percentages are given. For example, the modal frequency for 

males was 128 students scoring in the 35-39 TSWE range and receiving C's 

in their freshman English course. The modal frequency for females 

consisted of 188 students scoring in the 50-54 TSWE range and receiving 

B's in their freshman English course* For majorities the modal frequency 

vas 200 at a TSWE range o.f 45-49 and grade of B, snd for minorities the 

modal frequency was 66 az 35-39 and a grade of C. 
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Table 1 

TSWE/Grade Distributions for Male Students in 
Fourteen Colleges During the 1974-75 Academic Year 



TSWE 

Score 

Range 


A's 


Freshman English Course Grades 
B's C's D's 


F's 


Total 
















60+ 


lb 


12 


2 


0 


0 


29 


, • 55-59 


54 


57 


33 


4 


4 


152 


■ 50-54 


43 


102 


83 


8 


7 


243 


45-49 


23 


102 


127 


16 


3 


281 


\ 40-44 


16 


86 


93 ■ 


25 


19 


239 


35-39 , 


9 


7A 


128 


29 


29 


269 


' ' 30-34 


11 


42 


53 


17 


22 


145 


25-29 


. 3 


21 


37 


7 


23 


91 


20-24 


3 


11 


' 30 


10 


38 


92 


xocax 


1 77 


50/ 


Percentages 




155 

Jim -J -J 


1,541 

- - 


60f 


51.7 


41.4 


7.0 


0.0 


0.0 


100 


55-59 


35.5 


37.5 


21.7 


2.6 


2.6 


100 


50-54 


18.0 


42.0. 


34.1 


3.3* 


3.0 , 


100 


45-49 


8.2 


36.3 ■ 


45.2 


6.0 


5.0 


100 


40-44 


7.0 


. 36.0 


39.0 


10.5 


8.0 


100 


35-39 


3.3 


27.5 


^ 47.6 \ 
\ 37.4 


, 11.0 


11.0 


100 


30-34 


7.5 


28.6 


11.5 


15.0 


^ 100 


25-29 


3.2 


23.0 


41.0 


8.0 


.25.3 


100 


20-24 


3.3 


12.0 


33.0 


11.0 


41.3 


100 



Notes: 1. Unsatisfactory (U) grades counted as F» 
2. Satisfactorj (S) grades excluded ♦ 
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Table 2 



TSWE/Grade Distributions for Female Students in *• 
Fourteen Colleges During the 1974-75 Academic Year 



TSWE 
Score 




Freshman English Course 


Grades 






Range 


" A's 


o s 


C s 


D's 


F's 


■Total- 






* 


Frequencies 


* 

■ - 






60+ 


40 


24 


4 


0 


0 


. 68 


55-59 


77 


114 


49 


1 


- " 2 


243' 


^0-54 


71 4 


, 188 


88 


' 7 


7 • 


361 


45-49 . 


65, 


■ 158 


150 


8 • 


12 


. ■ 393. 


40-44 


21 


.97 


92 


9 


XT'. 


232 


35-39 


18 


93 


103 


19 


17 


250 


30-34 


13 


35 


80 


16 . 


9 


153 


25-29 


5 


18 ' 


37; 


6* 


23 


89 


20-24. 


2, 


9 


33 . 


6 


20 


70 


Total 


312 


736- 


636 ' ' 
* 

Percentages 


72 


103 


1 1,859 


60+ 


59.0 


35 .-0 


6:0 


0.0 • 


' 0.0 


100 


55-59 


, 32.0 


47.0 


20.1 


.4 


.8 


100 


50-54 • ' 


20.6 


52.1 


24.4 ■ 


2.0 


2,0. 


100 


45-49 - 


16.5 


■ 40.2 


38.2 


2.0 


3.0 


100 


40-44 


' 9.0 


42.0 


4-0.0 ' 


4,0 


6.0 


lo'o 


35-39 


• 7.2 


37.2 


41.2 


■8.0 


7.0 


100 


30-34 


8.5^ 


23.0 


52.3 •' 


10.4^ 


6.0 




25-2'9 


5.6' 


20.2 


41.6 


6.7 


26.0 


too 

\ 

100 


20-24 


2.8 


12.8 


. 47.1 

1 


8.6 

f 


28.6 



Notes: 1* Unsatisfactory (UX grades counted as 
2. Satisfactory (S) grades excluded. 
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< Table 3 ^ 

TSWE/Grade Distributions for Majority Students in 
Fourteen Colleger During the 1974-75 Academic Year 



TSWE 
Score 


-< 


Freshman English Course Grades 








^ A's 


B's 


G's 


D's 


F' Q 


XUuclJL 


• 




• 


Frequencies 




% 






' 28 '.- 


21 


"4 


0 


0 


• 53 


55-59" 


73 


104 


4^ 


2 


■ 5 


230 


50-54 


^'■'86 


193 


• 89 


11 


10 


389 


45-49 


79 


200 


166 


1^ 


16 


475 






110 


■ 107 


27 


19 


29o 






; 107 


145 


30 




00 J 




• 111 ^ 


.54 


79 


21 




JLO J 






ii 


34 


9 




/ J 








24 


8 




ACs 


To pal 


— -'350 ■ 


819- ' 


694 1 . 


122 


97 


2,082 




• 




Percentages 




■ 




6(H- 


52.8 


40,0' 


.7.5 


0.0 


0.0 


100 


55-59 


31.7 


^ 45.2 


20.0 


.9 


2.1 


100 


50-54 


22'. 1 


50.0 


; 22.9 


3.0 


2.6 


100 


45-49 


17.0 


*42.1 


35:0 


3.0 


3.3 


100 


40-44 


12*0 


37.0 


. 36.0 


9.0 


6.4 


100 


35-39 


6.4 ' • 


32.1 


43:5 


9.0 


7.0 


IDO 


30-34 


, 7.6 


29.5 


43.2 


11.4 


8.2 


100 


.25-29 


5.3 


" 29.3 


45.3 


12.0 


• ,8.0 


100 


20-24 


6.5 


17.4 


52.1 

t 


17.3 . 


. 6.5 


100 



Notes: !• Unsatisfactory '(U) grades counted'as F< 
2- Satisfactory (S) grades excluded. 
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Table 4 



TSWE/Grade Distributions for Minority Students in r 
Fourt.een Colleges During the 1974-75 Academic Year 



TSWE 

Score 

Range 


• 


Fresliman English Course Grades 
B's C's D's 


■F's 


Total 




- 




Frequencies 




• 


- 


6CH- 


2 


2 


0 


0 


0 


4 


CO 




9 


6 


0 


n 
u 


zu 


50-54 


3 


21 


14 


1 


2 


41 


45-49 


7 


•44 


35 


2 


8 


96 


40-44 


6 


30 


32 


1 


6 


75 


35-39 


5 


' 46 


66 


5 


16 


138 


30-34 


7 


21 


58 


7 


J 




25-29 " 


2 


17 


38 


■ 2 


30 


89 


20-24 


2 


14 


39' 


6 


41 


102 








ZOO 




112 


667 




- 




Percentages 








60+ 


50.0 


50.0 


0.0 


0.0 


0.0 


100 


55-59 


25.0 


45.0 


30.0 


0.0 


0.0 


100 


50-54 


7.3 


56.2 


34.1 


2.4 


4.8 


100 


45-49 


9.2 


31.6 


46.1 


2.6 


10.5 


100 


40-44 


8.0 


40.0 


42.7 


1.3 


8.0 


100 


35-39 


3.6 


33.3 


48.0 


3.6 


11.6 


100 


30-34 


6.9 


20.6' 


56.9 


6.9 


8.8 


100 


25-29 


2.2 


19.1 


42.7 


2.2 


33.7 


100 


20-24 


1.9 


14.0 


38.2 


6.0 


40.2 


100 














■? 



Notes: 1. Unsatisfactory (U) grades counted as F. 
2. Satisfactory (S) grades excluded. 
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Of principal interest in the group comparisons is whether the TSITE 
scores and the grades appear to- relate in a similar way for all four 
groups. Consider the grades made by thosQ students making the maximum 
possible TSWE score (6(H-) . Over half (52%) of males in this category 
made A, 59% of females made 53% of majorities, and 50% of minorities 
(note that the 50% minority figure is based upon only 4 minorities who 
obtained the maximum TSWE score). More stable percentages can be obtained 
by "J^'^S ^ lov;er TSWE cutting score and combining the A and B grade 
frequencies. For example, of those scoring 50 or above on the TSWE, 
67% of males made A oi B,;76% of females, 75% of maj^orities, and 65% 

- ^ , 

of minorities. Consider also low score ranges. Of those students scoring 
below 30 on the TSWE, only 21% of males made A or B, only 18% of females, 
only 30% of ma^^prities, and only 18% of minorities* 

A more systematic analysis, of the distributions ^f grades and TSWE 
scores can be made through a consideration pf "hits" and "misses". Hits 
might be assumed to ba of two kinds: (1) those students who made either 
A or B in their freshman English courses and who scored relatively high 
on the TSWE, and (2) those students who made C, D, or F and who scored 
relatively lo>? on the TSWE (the inclusion of C students in misses 
reflects recent trends toward inflated grades) . Conversely, misses ate 
of the two opposite kinds: (1) those students who made A or B but who 
scored relatively low on the TSWE, and (2) those students who made D or 
F but scored relatively nigh on the TSWE. If a cut is made at a score 

of 40, we have a four-fold table of this type: j 

/ 

/ 



7 











A or B 


C, D, or F 


TSWE >^ '40 


Hit 


Miss 


TSWE < 40 


Miss 


Hit * - 



If such a table is constructed for all four groups being considered 
a comparison can then be made of the ratio of hits to misses for each 
group, 'ghe numbers ofi^hits and misses for each group are obtained by 

summing values in Tabids 1, 2, 5,, and '4. The resulting tables, with 

\ 

the hit /miss ratios,^ are given below. « 



TSWE 21 40 
TSWE < 40 



Males (1541) 
A or B C, D, or F 



510 


434 


"174 


423 



TSWE- 5^ 40 
TSWE < 40 



Females (1859) 
A or B C, iP, or F 



H/M = 7^ = 1.53 



'> ■ 

855 


442 


193 





608 

Majorities (2082) 



1.93 



: : "635 
Minorities (667) 







A or B 


C, D, or r 






A or B 


C, D, or F 


TSWE 


1 40 


929 


516 


TSWE 


>_ 40 


129 


107 


TSWE 


< 40 


240 


397 


TSWE 


< 40 


ll4 


317 



„, 1326 T 



K/M = ||f= 2.02 



These hit/miss analyses suggest that the TSWE is most useful as a 
predictor of perfon^ance -(as measured by course grades) for females 
and least useful for males. The male problem is apparent from the 
figures in the right--hand side of the table for jnales. About the same 
number of high-scoring males made low grades (434) as did low-scoring 



males (423). 



A difficulty with the hit and miss approach is Its dependence 
upon the cutting score. If the cut is made at 33, for example, different 
hit/miss ratios are obtained: 



Males 
(1,541) 



Females 
(1,859) 







A or B 


C,D, 
or F 




A or B 


C,D, 
or F 


TSWE > 


35 


593 


620 


TSWE >^ 35 


; 973 

.,i 


303 ! 


TSWE < 


35 


91 


237 


mm < 35 


j 


508 ! 

■ 1 



H/M = 1.17 



H/M = i|||= 3.92 



Majorities 
(2,082)- 



Minorities 
(667) 







1 - 

A or' B 


C,D, 
or F 






A or E 


' C,D, 
or F 


TSWE > 


35 


1064 , 


714 


TS\^E >_ 


35 


■180 


194 


TSWE < 


35 


105 


199. 


TSWE < 


35 


63 


230 



H/M - i^-. 1.54 



H/M.||f=1.60 



Comparing the ratios for a cut at 35 with those obtained with a cut at 
40, it can be seen that the hit/miss ratio for females increases 
substantially while those for the other three groups decreased slightly. 



Comparisons of Course Placenient 

Tables 5 and 6 compare the characteristics of students placed in 
different instructiopdl sequences. A short-sequence usually consisted of 
one course (one semester or quarter) and a long-sequence two courses (two 
semesters or quarters). Usually, the better students are assigned to the 
shorter sequences. Table 5 shows TSWE score means, standard deviations, 
and ranges for the four groups of interest subclasslf ied by instructional 
sequence. Table 6 shows course grades for the same subclasslf ication. 
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Table 5 

Comparison of TSWE Pretest Means, Standard Deviations, and 
Ranges for Short- and Long-sequence Freshman English Students 
in Fourteen Colleges During the 1974-75 Academic Year 



Group 


TSWE Scores 
Short-sequence 


for 
Students 


TSWE -Scores 
Dong-sequence 


for . 
Students 


N 


Mean 


S 


.D. 


Range 


N 


Mean 


S 


.D. 


Range 


Male 


1268 


44. 


4*^ 


9 


.1 


20- 


-60 


356 . 


35.1 


9 


.8 


20- 


-60 


Female 


1549 


46. 


6 


8 


.9 


20- 


-60 


192 


33.5 


^ 9 


.4 


20- 


-59 


. Majority 


1601 


45. 


2 


9 


.0 


, 20- 


-60 


188 


40.6- 


9 


■3 
. ^ 


20- 


-60 


Minority 


265 


39. 


7 


10 


.0 


20- 


-60 


348 


32.9 


9 


.2 


20- 


-59 



\ 



J 
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Table 6 



Comparison of Course Grade Means, Standard Deviations, and 
Ranges for Short- and Long-sequence Freshman English Students 
in Fourteen Colleges During the 1974-75 Academic Year 



V 

Group 


Grades for Shert- 
sequence Students 


First 
for Long- 


course Grades 
sequence Students 






Mean 


S.D. 


Range ^ 


N 


Mean 


'S.D. 


Range ^ 


Male . 


. 1268 


2.34 


1.04 


0-4 


356 


2.04 


1.31 


0-4 


Female 


1549 


'2.68'^ 


.93 


0-4 


192 


1.92 


1.29 


0-4 


Majority ■ 


, 1601 


2.52 


1.03 


0-4 


188 


-2.67 


• .88 


0-4'= 


Minority 


265 


2.12 


1.03 


0-4 


348 


1.96 


1.28 


0-4 



Grades coded zero may represent either Fail ^or Unsatisfactory. 

• b . 

Of the 1601 majority students, 199 (12.4%) had grades of D, P, or 
U, whereas of the 265 minority students, 49 (18.5%) had grades of D,. P, 

c 

Only 10 of the 188 majority students (5.3%) had grades of D, F, 
or U, whereas 82 of the 348 minority students (23.6%) had grades of D. 
F, or U. .. 



In Table 5, an interesting observation is that the ranges of TSWE 
scores are about the same regardless of instructional placement* Even 
though the mean TSWE scores were higher for short-sequence students, the 
assignment of students at extremes of TSl^E scores to both sequences sug- 
gests a lack of precision in placement. With respect to the sex and 
ethnic classifications, Tat>le 5 shows that the average TSWE score for 
the short-sequence minority group was substantially less (39.7) than the 
average JCSWE score for the other groups (between 44.4 and 46.6). For 
long-sequence students, the mean TSWE score for majorities was somewhat 
above the mean TSWE scores for long-sequence males, females, and minori- 
ties. Suggested is a proclivity for "over-placing*! minorities and for 
"under-piacing" majorities. 

The course grade averages in Table 6 paralleled the TSWE averages. 
The mean course grade for short-sequence minorities (2.12), like the mean 
TSVfE score for short-sequence minorities, were well below the mean course 
grade for the other groups. And the mean course grade for long-sequence 
majorities (2.67), like the mean TSWE score^for long-sequence majorities, 
was much Llgher than the mean course grade for the other groups. Thus, 
the course grades seemed to follow the TSWE averages and support the 
judgment of a lack of precision in placement made from the, TSWE score 
observation. 

Correlational Analyses 

Tables 7, 8, 9, and 10 give correlations among 14 variables when 
data for all 14 colleges were pooled, isote that data were not avail- 
able on sll variables for all groups in sufficient quantity to allow 




for stable correlations. Thus, <asbes (-) in thess^ tables indicate 
either that no data were available or that the number of cases for which 
a correlation could be computed was less than 50. Nevertheless, 
interesting comparisons can be made for a number of the correlations. 

Fall grades for long-sequence students appear to correlate with 
the TSWE Pretest scores, with slight variations for each of the groups: 
.30 for males, J1 for females, .30 for majorities, and .33 for 
minorities.^ Similarly, the fall grades for short-sequence students 
also correlate with the TSWE pretesv 6::ores: .39 for males, .36 for 
females, .34 for majorities, and .43 for minorities. The differences 
in these correlations are probably not worthy of note, given the *dif f erent 
sizes of tbe samples upon which they are based and the differences in 
the variances for each of the groups. 

The prediction of fall grades on the basis of the Essay Pretest 
can also be compared for each of the groups. These correlations are less 
than those above representing the same pi;ediction using TSWE scores, but 
no important differences among groups are discernible: .33 for males, 
•21 for females, *21 for majorities, and .25 for minorities. Thus, these 
correlations indicate that the TSWE is somewhat more related to course 
grades than is the Essay Pretest, for all groups* 

Despite the apparent superiority of the TSWE over an essay* as a 
predictor, the TSWE Pretest (Variable 12) and the Essay Pretest (Varia-- 
ble 10) correlate rather well with each other for all groups: .41 for males 

^Note, however, that grade correlations may be attenuated by the pooling 
-of grade data for colleges with different grading standards, ' 
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Variable Nuciber 
and 
Descripcion 



Tabid 7 

Correlation Matrix for Hales in Fourteen Collegea 
During the J 9 76-75 Academic Year 



Variable" Number 



^ 8 



10 



11 12 



1; Fall Grades (Long-sequence) 

2. Fall Grades (Short-sequence) 

3. TSiJE Post test 

4. Essay Posttesc (Holistic) 

5. Essay Posttesc (Granunar) 

6* Sprin;; Grades (Shore- 
sequence) 

7. Spring jG rades (Long- 

sequence) 

8. Spring* Grades (Total) 

9. High School Rank 
V ^ (Self-report) 

10, Essay Pretest 

' 11. CLE? English Comp. 

12. TSWE Pretest 

13. SAT-V Pretest 

* 14. High School Rank 
(College report) 



50 



• 29 



.48 

.48 
.10 
.33 

.30 



.50 .13 

.29 .32 ^ 

.36 ,64 

.39 .59 

.29 .23 

.19 ~ 



106 106 284 
194 816 
54 50 



1.00 1.00 
.13 .20 



.19 



.31 .26 



163 



, 452 
160 1513 
134 146 



194 76 
444 ' 139 



215 



196 



.17 

.06 .30 
.28 .26 
.10 .16 
.50 



.41 



- 194 

- 444 

69 638 

102 162; 

- ' 204 
260 

.59 

.56 .59 

.18 .17 



Note: Correlations below diagonal, number of ca§cs above. 
Correlations based on les-s than 50 cases not shovn. 



13 _ 14 



280 60 
95 



n 

70 63 

216 58 
371 64- 
64 

.30 



O * ^ 



I 

H 
I 



Table 8 

* Correlation Matrix for Females in Fourteen Colleges 
During the 1974-75' Academic Year 



Variable Nu^nber 
and 



Variable Number 





Description 


1 


2 


3 




5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


1. 


Fall. Grades (Long-sequence) 




- 


61 


- 


- 


- 


82 


82 


332 


198 


61 


A18 


- 


- 


2. 


Fall Grades (Short-sequence) 


- 




155 


58 


58 


- 


- 


319 


1261 


68 


286 


1979 


366 


97 


a 


ioWc< rcsttest 


.51 


.25 










59 


73 


69 




266 


285 


206 






Essa;^ Posttcst (Holistic) 




.47 






60 








60 




59 


60 


55 


52 


5. 


Essay Post test (Gramsiar) 


- 


.56 


- 


.52 










60 




59 


60 


55 


* 52 


6. 


Spring Grades (Short- 
sequence) 


- 


~ 


- 




- 






319 


188 


- 

ft- ^ 


- 


319 


_ 




^ 7- 


Spring Grades (Long- 
scqucace) 


.42 














369 


166 




58 


369 


— — 
— 


— 

— 


8* 


Spring Grades (Total) 


.42 


.55 


.30 


- 


- 


1.00 


1.00 




358 


- 


79 


688* 


74 


- 


9, 


High School Rank 
(Self-report) 


.19 


.31 


.43 


.37 


.31 


.35 


.24 


.32^ 




254 


165 


?260 


109 


101 


10. ' 


Essay Pretest 


.21 


,17 






_ 








.25 






265 






11. 


CLE? English Comp. 


.42 


.43 


.76 


.50 


• 47 




.23 


.23 


.50 






417 


348 


99 


12. 


TSWE Pretest 


.42 


.36 


.72 


.41 


.53 


.31 


.•2i 


.29 


.37 


.45 


.66 




464 


101 


13. 


SAT-V Pretest 




.38 


.65 


.52 


.45 






.39 


.42 




.73 


.67 




99 


14. 


High School Rank 
(College report) 




.35 




.32 


.32 








^ .62 




.40 


.43 


.31 





Notes Correlations below diagonal, number of cases above. 
Correlations based on less than 50 cases not shown. 
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"Variable Nuabai* ^ 
and. 
Description 



!♦ Fall Grades (Long-sequence) 

2. Fall Grades (Short-sequence) 

3. TSj^ Posttest 

4* Essay Po^sttest (Holistic) 

5. Essay Post test (Gransnar) 

6, Spring Grades (Short- 

sequence) 

7* Spring Grades (Long- 
sequence) 

8* Spring Grades (Total) 

9* High School Rank 
(Self-report) 

10, Essay Pretest 

XI. CLEP English Conp. 

1,2, TSWE Pretest 

X3.^ SAT-V Pretest 

14. High School Rank 

(College report) ^ , . 



Table 9 - ^ 

Correlation Matrj:x*for Majority Students in 
Fourteen Colleges During the 1974-75 ^cademic Year 



Variable Number 



8 



10 



11 



12 . 13 



14 



82 



92 92 



.45 



85 85 526 
258 1787 

53 



.44 

.57 



.47 



.31 



.36 




73 . 82 235 

51 175 -1347 167 156- 
- • 85 115 



93 
93 



- 1.00 1.00 
► 33^ '.39 .30 .22. .29 



.31 .45 .36 
.23 .35 .37 
.21 .30 - 

.45 .54 1.00 .47 .52 
.30 . 34 .74"^"* .44 .54 .27 
.29 - .34 " .27 
.25 .31 



10 ' ^ 



94 

94 
253 

¥ 

261 

\ 
519 



89 

* 

89 



83 
33 



.25 .31 



.33 - 

r 



.37 
.47 
.39 
.29 
.57 



109 255 2977 
124 



177 163 



.33 .67 
.52 
.33 



262 1j67 156 

178 164 

•53 162 
.35 ,33 



Note: Correlations below diagonal » number of cases above. 
Correlations ba^ed -on less 'chan*5'0 cases not vhcnm. 
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Table 10 

Correlation Matrix for Minority Students in 
Fourteen Colleges During the 1974-75 Acadeaic Year 



Variable Kuaber 
and 
Description 



Variable Number 



* 1 



8 



10 11 



12 



1. Fall tJrades (Long-sequence) 

2. Fall Grades (Short-sequence) 

3. TSWE Posttest 

^ 4. Essay Posttest (Holistic) 

5. Essay Posttest (Gransaar) 

6, 'Spring Grades (Shore- 

sequence) 

7, Spring Grades (Long- 

sequence) 

8. Spring Grades (Total) 

9> High School Rank 
(Self-report) 

10. Essay Pretest 

11. CLEP English Conp. ' ' 

12. TSWS Pretest 

13. SAT-V Pretest 

14. High School Rank * 

(College report) 



.14 
.25 



.27 
.17 



.33 .43 - 



361 '264 
263 55 



305 



54 50 
1.00 ^ • 60 
.31 -.32 

.23 



.01 .10 ;25 .44 



373 
274 



54 

64. 
845' 

319 



Note: Correlations balow diagonal, nuiaber of casen above. 
Correlations based on less than 50 cases not shown. 
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.45 for females, .33 for majorities, and .44 for minorities. Again 
these differences in correlati^ons may be the result of a number of chance 
factors and, accordingly, generalizations with respect to differences 
among them are not appropriate. Further comparisons "of TSWE and essay 
scores are presented in Part II which folic s. 
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Part II: Group Comparisons for the 
1975-76 Data Set 

* « 

The four institutions participating in the 1975-76 study provided 
data on 9,144 students identified by sex and 7,718 students identified 
by ethnic status. This , total included 5,162 males, 3,982 females, 6,83^. 
majorities, and 879 minorities. The 879 minorities c5nsisted of 21 
American Indians, 683 Blacks, 8 Mexican-Americans, 134 Asian-Americans, 
and 33 Puerto Ricans. Whereas the focus in ^ the 1974-7-5 data collections 
was on relationships between TSWE scores and coarse grades, the focus In 
the 1975-76 data collections was on actual writing samples*' Over 2,500 

samples of writing were obtained, and most of these could be compared with 

t 

TSWE scores for the same students. As in Part I, ?art II contains bivar- 
iate distributions, but the two variables are TSWE scores and essay scores 
rather than TSWE scores and grades. Theqe bivarir.te distributions were 
generated for each of the four groups of interest. Correlational tables 
were also developed for each of the four groups, as before. Regression 
analyses, which were not conducted for the Part I data, are presented 

for Part II. No analyses of placement by group were conducted for 

the Part II data. 

Comparigons of Distributions 

^ Tables 11, 12, 13, and 14 present a comparison of TSWE scores and 

2 . • - 

essay scores for the four groups.^ The essays were scored by two 

2 ' 

These TSWE scores were obtained at the time students took the SAT when 
applying for college. The essay scores were obtained during the fresh- 
man year of college. 



Table 11 

-TSWE/Essay Score Distributions for Male Students in 
Four Colleges During the 1975-76* Acadeiqic Year 



TSWE (SAT) 



Essay Score 



ERIC 



Range 


12 


11 


10 


9 


8 


7 


% Above 
Av.erage 


■ 6 . 


5 


4 


3 


9 




-course 


Essay Score Frequencies 


1 * 1 










- 


OUT 




1 


1 


1 


1 


1 


! t 

, » ! 
[ 62% 


3 












y 


4 


10 


13 


,7 


11 


! 1 

■ { 82% { 


5 


3 


2 






50-54 


2 


3 


4 


7 


18 


10 


68% { 


16 


2 


2 

* 


1 






1 




2 


6 


11 


14 


1 1 

1 59% [ 
t 1 


8 


11 


3 


2- 




A n /i A 






1 


5 


10 


6 


1 1 

j "48% } 


13. 


f 

15 


13 . 


3 










1 


4 


8 


9 


1 1 

j ^i'^ ! 


14 


17 


9 


5 










1 


1 


2 


4 


I 11% { 
1 * 1 


5 


23'' 


21^ 


^8 




ZD— zy 










4 


1 


1 1 

I 9% 1 
1 1 


5 


16 


13 


12 


4 














1 


1 i 
1 2% { , 


1 


8 


10 


"19 


6 


Pos t- 


course 


Essay Score Frequencies 














50+ 


1 






4 


1 




1 86% j 




1 








55-59 


1 


3 


8 


9 


15 


8 


1 80% I 


9, 


2 






• 


50-54 




4 


5 


17 


.9 


13 ' 


j 70% j 


11 


5 


3 . 


1 




45-49 




4 


7 


6 


11 


12 


! 73% j 


8 


5 


1 


0 


1 


40-44 


1 


1 


1 


6 


11 


15 


1 54% 1 


12 


10 


6 


1 


1. 


35-39 






2 


8 


9^ 




i 46% j 


15 


12 


3 


4 


1 


30-34 




1 




2 


6 


10 


! 26% 1 


20 


17 


9 


5 


2^ 


25-29 








1 


5 


5 


i 24% 1 


2 


18 


6 


4 

jr. 


4 


20-24 








• 


2 


1 


1 10% 1 


5 


6 


4 


8 


3 



1 

-22- 
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Table 12 

TSWE/Essay Score Distributions for Female Students in 
Four Colleges During the 1975-76 Academic Year r 



TSWE (SAT) 



Essay Score 



Score 
Range 


12, 


11 


■. 10 


9 


■ 8 


7 


% Above 
Average ^ 


6 


5 


4 


3 


2 


jt re"" 


•course 


Essay Score Frequencies 


1 














JL 


4 


5 


. 4 


(, 


3 


1 
1 

n o 9/ 1 

92% i 


2 














7 


9 


8 


16 


14 


' 1 

O/ cy 1 


c 

0 


5 ^ 








50-54 


1 


6 


10 


»12 


18 


- 

15 


r 

80% 1 
1 


8 


5 


.2 






AC AO 






4 


6 


9 


13 


78% 1 
1 


3 


4 


1 


1 




/. A_/. /. 




1 


1 


4 


8 


11 


1 

c o e/ } 1 

58% ^-1 
1 


12 


51 


1 










1 




3 ; 


1 


6 


1 

/9% 1 

i 


9 


1'2 


4 


2 




JO— JH 










2 


8 . 


35% 1 
r 


o 
0 


5 


5 








• 




1 






1 

1 


1 

5% 1 


7 


0 


c 


2 




on OA 

zU— 












1 ! 


i 

/% 1 ^ 




o 

J 


/ 


" /, 




Post- 


•course 


Essay Score Frequencies 








*■ 






£ AO. 
OUT* 




5 


6 


4 


5 


2 


Q 0 or/ "1 


o 
Z 










55-59 


3 


7 


11 


11 ' 


19 


7 1 


89% I . 


5 


2 






- 


50-54 


4 


5 


12 


13 


10 


12 1 


80% .i 


8 


3 


"3 




• 


45-49 


,1 


3 


4 


^ 4 


9 


8 1 


69% I 


10 


2 






1 


40-44 






1 


5 


8 


■6 


50% 1 


14 


3 


2 


1 


0 


35-39 




1 


3 




4 


' 8 1 


44% I 


9 


3 


'6 


1 


1 


30-34 








3 


1 


3 1 


24% '1 


7 


6 


3 


4 


2 


25-29 










2 


1 1 


15% I 


7 


4 


3 


1 


2 


20-24 














0% 1 . 


3 


6 


Z 


2 ■ 


3 
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' Table '13 . 

TSWE/Essay Score Distributions for Majority Students in 
Four Colleges During the 1975-76 Academic Year 



TSWE (SAT) 
Score 
Range 



Essay Score 



12 11 10 



8 



% Above 
Average 



Pre-course Essay Score Frequencies 



60+ 


1 


5 


5 . 


5 


6 


4 


j 90% 


1 








• 


55-59 ■ 


3 


9 


15 


16 


19 


21 


! 81% 


1 


7 


2 






50-54 


3 


9 


12 


13 


25 


20 


1 74% 


\ 20 


' 5 


3- 






45-49 


1 




4 


9 


.16 


21 


! 65% 


10- 


11 


4 


2 




40-44 , 




1 


2 


6 


"•12 


10 


[ 

j 41% " 
1 


15 


ll 


' 12 


1 • 




35-39 






1 


7 


5 


11 


1 

1. 34%. 
! 


17 


20 


6 


3 




30-34 






1 




1' 


6 


1* 1 

1 17% 1 
! 1 


6 


13 


13 


' 1 


. 4 


'25-29 










3 


1 


1 j 

! 11% i 

! 1 


5 


14 


10 


4 




?0-24 












1 


1 1 
! 9% 1 




2 


6 


1 




Post- 


•course 


Essay Score Frequencies 














60+ 




5 


6 


6 


5 


2 


i 89% 1 


2 


1 








55-59 


3 


6 


14 


17 


29 


12 


I 83% i 


12 


4 








50-54 


3 


8 


13 


23 


16 


18 


1 74% 1 


17 


7 


4 


1 




45-49 


■ I 


6 


9 


8 


16 


18 


I 75% i 


10 


7 


1 




1 


40-44 


1 


1 


2 


8 


13 


19 


i 57% i 


16 


10 


4 


2 


1 


35-39 




1 


3 


6 


11 


13 


1 48%: 1 


19 


7 


6 


4 




30-34 






1 


2 


5 


9 


1 31% 1 


13 


10 


7 


3 


2 


25-29 








1 


4 


4 


1 27% 1 


3 


14 


6 




1 


20-24 










1 




1 8% ! 


2 


4 


2 


2 


1 
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1.-.- Table 14 




w 










■ 


TSWE/Essay Score Distributions for Minority Students 


in 








• 


Four Colleges During the 1975-76 Academic Year 










TSWE (SAT) 
Score 
Range 






Essay Score 














12 11 


10 9 8 7 


% Above . 
Average 


6 


5 


4 


3 


2 




Pre- 


*• 

-course Essay Score Frequencies 


t 

1 1 














. 60+ 






^ 1 / !' 
1 ;' 0^ ! 














55-59 




1 


. 1 100% 1 














* 50-54 


• 


3 2 1 


} 67% j 


,3 












45-49 




2 3 


j 62% j 




3 










. 40-44 




1 "3 5 


1 64% 1 


3 


• 


2 






r 


- 35-39 


1 


1 


' j 13% j 
'1 22% j \^ 


3 


4 


5 


1 






30-34 




13 2 


1 


8 


9 


1 


2 




25-29 




/ 

/ 


I 0% i 


2 


3 


5 


2 


2 




20-24' 


• 


1 






8 


7 


6 


4 




Post- 


-course Essay 


Score Frequencies 








• 








60+ 






1 0% ! 










- 




55-59 


1 


1 


1 100% ! 










• 




50-54 




1 1 3 


! 62% ,' 


1 • 


1 


1 








* 45-49 






I 50% ,' 


3 






- 


1 




40-44 




• 3 1 1 


I 38% ! 


3 


1 


4 








35-39 




1 13 


1 31% j 


3 


5 


2 




1 




30-34 




2 1 '2 


! 1 H'y ! 


0 


C 

D 


3 


3 


2 




25-29 




1 


i i 


4 


1 


2 


, 2 


5 

/ 




20-24 




1 


] 4% i 


5 


6 . 


3 


5 




* 
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• 









1 

different readers, independently, on a scale from 1 (poor) ko 6 (good). 
The two independent scores were then added to yield an essajr score scale 
from 2 to 12, The average • ay score fell between 6 and ?• In Tables ' 
II, 12, 13, and 14 scores of 7 or above were, ther^fore^, classified as 
above average and a percentage computed of those students writing. above 
average esaays for each of the TSWE score ranges. The tables show that 
the percentage of students nritirig above average assays tend to decrease 
as the TSWE score decreases. For example, over 80%"' of students scoring 
in the 55-59 TSWE score range wote above average essays regardless of 
group membership. Much smaller percentages of , those in the lower TSWE 
score ranges wrote above average essays. 

Hit and miss analyses similar to those presented in Part I, 
comparing TSWE scores and course grades, can be conducted for TSWE scores 
and essay writing performance. Consider hits of two types: (1) students 
scoring AO or above on the TSWE and writing essays with scores of 7 or 
above, and (2) students scoring below 40 and writing essays with scores 
of 6 and below. Misses are then obtained from the opposite quadrants: 
(1) students scoring 40 or above on the TSWE but writing essays with 
scores of 6 and below, and (2) students scoring below 40 on the TSWE but 
writing essays with scores of 7 and above. The four-fold table will then 
be : 

Essay Score * - 







7 to 12 ' 


2 6 




TSWE > 40 


Hit 


>tLss 


» 


' TSWE < 40 


Miss 


Hit 
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Tiie^rafcio of hits to misses' can be computed, as in. Part I and 
these ratios compared, for tlie four groups. Fro^n Tables 11, 12, '13, and 
14, the' following hit/miss tables are derived: 



>iales Females ' 









(514) , 
„ Essay • Essay. 
7 to 12 2 to 6 * 








(403) 
Essay Essay 
7 to 12 2 to 6 


TSWE 


> 


40 


151 


102 


TSWE 


> 


40 


200 


101 


TSWE 


< 


40 


36 . 


225 


TSWE 


< 


40 


23 


79 








H/M = |2|= 2.72 








H/M = 


- = 2.25 








Majorities 
' (681) 
Essay Essay 
7 to 12 2 to 6 








Minorities 

(115) . 
Essay Essay 
7 to 12 ' 2 to 6 


TSWE 


> 


40 


273 


122 


TSlfE 


> 


40 


22 


11 


TSWE 


< 


40 


37 


249 


TSWE 


< 


40 


9 


73 








H/M - 3.28 










■ = 4.75 



\ While in Part I grades were most predictable* for females, these 
hit and miss analyses of essays suggest a best prediction for minorities. 
There were almost five times as many hits as misses for minority students 
And also unlike the grade predictions, females (rather than males) were 
least predictable* Still, there were over two times as many hits as 
misses for females. ' ' 

As in the hit arid miss analyses of grades in Part I, a change in 
the cutting score changes the ratios. If the cut is made at a TSWE score 
of 35, these tables and ratios are obtained: 



Males 
(514) 



Females 
(403) 







Essay 


Essay 






. Essay 


Essay 






7 to 12 


2 to 6 






7 to 12- 


2 to 6 


TSWE > 


40 


173 


147 


TSWE 


> 40 


^ 211 


128 


TSWE < 


40 


14 


180 


TSWE 


■< 40 


12 


52 



H/M = Iff =2.19 



H/M= III =1.88 



Majorities 
(681) 



liinorities 
(115) 







Essay 


Essay 




Essay 


Essay 






7 to 12 


2 to 6 




7 to 12 


2 to 6 


TSWE >. 


40 


297 


168 


TSWE > 40 


24 


24 


TSWE- < 


40 


13 


203 


TSWE < 40 


7 


60 



H/M = III =2.76 



H/M = Ij- = 2.71 



The reduction of the cutting score from 40 to 35 decreases the hit/miss 

ratios for all groups. , 1 . . 

1 

Correlational Analyses ^ ' • 

The corralational analyses of Tables 15, 16, 17, and 18 show the 

i:elationships between TSWE scores and- essay scores in another way* 

Variable 5 is the TSWE score obtained when students, took the SAT,^ 

^ 1 ^ ' . 

Variable 10 is a TSWE test administered at the participating institutions 

toward the end of the first freshman English course. Variables 8" and IX 

are Scores obtai^ied on the graded "Writing samples. The correlation 

r 

between Variable 5 (TSWE) and Variable 11 (Essay Posttest) is .54 for ' 
males, *6l for females, .51 for majorities, , and .49 for minorities. 
Similar comparisons can be made between Variables 5 and 8 and between 
Variables 8 and 11. For all groups, the TSWE Pretest tends to predict 
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Table 15 * ■ ' 
Correlation 'Matrix for Males in Four Colleges During the 1975-76 Academic Year 



Var4;able Number 
^ and . 
' Description 



1. High School Rank 

2* High Schoc^J.'^Sn^lish Grade 

3. SAT Reading 

4* SAT Vocabulary 



S 5* TSWE (SAT)-. 



6. SAT-V 

/ 

1. SAT-M. 

8. Essay Pretest 



9, College; English Grade 



10 



sttest 



11. Essaf '^Josttest 
t 



.56 
.36 
.34 
.38 
.37 
.4JE 
.31 
.22 
",38 



4123. 3226, 3227 
3267 3267 



.35 
.32 
.36 
.35 
.25 
.32 
-.21 
.38 



, .30 • ..2t 



.77 
.69 
.95 
.56 
.55 

■ .23 
.69 

-'.'48 



3961 



.69 
.93 
.56 
.57 
.20 
.65 
.48 



Note: Correlations below diagdnal, number' 6f cases above, 
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Variable Number 



8 



10 



3227 4283 4283 • 479 *2242 506 

3267. 4209 4209' 458 2206 487 

3961 3961 3961 462 2060 489 

3962 3962 3962 ' 462 2061 489 
3962 3962 462 2061 489 

•74 5162 568 2667 604 

.56 .60 462 2061 489 

.62 .61 .42 . 537 514 

.'27 .24 .18 .28 576 

' .81 .72 .55 '.66 .28 • 

.54 -.49 .40 .48 .23 .54 



11 



475 
454 
462 
462 
462 
567 
462 
538 
533 
530 



40 



Table 16 

Correlation Matrix for Females in Four Colleges During the 1975-76 Academic Year 



Variable Number 



Variable Number 





Description 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


1. 


High School Rank 




3375 


2532 


2532 


2532 


3349 


3349 


372 


2016 


362 


366 


2., 


High School English Grade^^ 


.56 




2580 


2580, 


"2580 


3414 


3414 


374 


2037 


359 


364 


3. 


■ SAT Reading 


♦ .41 


.36 




3051 


3051 


3051 


3051 


357 


1835 


347 


342 


A. 


SAT Vocabulary 


.39 ' 


.34 


.75 




3051 


3051 


3051 


357 


1835 


347 


342 


5. 


TSWE (SAT) 


.44 


.39 


.69 


.68 




3051 


3051 


357 


1835 


347 


342 


6. 


SAT-V 


.43 


.37 


.94 


.93 


.74 

r 




3982 


439 


2343 


423 


423 


7. 


SAT-M 


.48 


.32 


.59 


.58 


.60 


.62 




439 


2343 


423- 


423 


8. 


Essay Pretest 


.33 


.33 


.53 


.53 


.60 


.51 


.46 




417 


381 


404 


9. 


College English Grade 


.12 


.09 


.25 


.22 


.25 


.26 


.22 


.27 




409 


409 


LO. 


TSWE Posttest 


.55 


.50 


.73 


.73 


.85 


.76 


.64 


.54 


.25 




■"396 


LI. 


Essay Posttest 


.32 


.37 


.56 


.53 


.61 


.54 


.47 


.50 


.21 


.56 





Mote: Correlations below diagonal, number of cases above. 
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Table 17 . - . ^ . 

Correlation Matrix for Majority Students in Four Colleges During the 1975-76 Academic Year 



Variable Number. 
Description 



1. .High School Riink 

« 

2. High School English, Grade 



3. SAT Reading 

4 . SAT 'Vocabulary 

5. TSWE (SAT) 

* 

6 . SAT-V 

7 . SAT-M 

8. Essay Pretest 

9. College English Grade 

10. TSWE Posttest 

11. Essay Posttes^ 



.57 



..44 



Variable Number 



10 



6457 4904 4904 4904 6484 6484 669 3648 673' 



.41 .36 



.38 .32 



4991 4991 4991 6603 -6603 678 3705 685 



5073 5073 5073 5073 561 2881 569 



.74 



.40 .65 .63 



5073 5073 5073 561 2881 ' 569 
5073 5073 561 2881 569 



.42 .36 .94 .92 .69 



.43 .20 .50 .51 



.48 .55 



.34 .36 .50 .49 .58 .52 
.17 .19 .21 .17 .25 .22 



.49 .46 .68 .61 



.80 .69 



.43 .56 



,24 



35 .33 .45 .40 .51 .44 .26 .47 .20 .51 



Note: Correlations below diagonal, nianber of cases above, 



11 



658 
667 
554 
554 
554 



6715 685 3741 691 674 

685 3741 691 674 

.29 645 605 637 

.11 .27 659 640 



627 



4J 



44 



Tabic 18 

Correlation Matrix for Minority Students in Four Colleges During the 1975-76 Academr.c Year 



Variable Number 
, and 
Description 



Variable Number 



10 ■ 11 



1. High School Rank 

2. High School English Grade 

3. SAT Reading 

A. SAT Vocabulary 

5. TSWE (SAT) 

6. SAT-V 

7. SAT-M 

8. Essay Pretest 

9. College English Gradf 
10. TSWE Posttest 



.51 
.17 
.17 
.21 



.31 



.24 



.25 



.32 



,05 .12 



818 704 704 704 828 . 828 129 443 134 128 



713 713 713 842 842 130 447 135 129 
742 742 742 742 115 387 118 113 



,76 



.70 .70 



742 742 ■ 742 115 387 118 113 



.20 .26 .94 .93 .75 



,18 



.21 .39,, .56 



.55 



742 742 115 387 118 113 



.17 .52 ,.51 .50 .57 



871 134 461 138 132 
134 461 138 132 



.12 .24 .49 .51 .63 .55 .31 



128 116 124 



,18 .20 .17 ■ .16 



,78 .66 .42 .63 



.20 



132 126 



119 



11- Essay Posttest 



.05 .26 .36 .48- .49 .46 .30 .50 .10 .50 



Note: Correlations below diagonal, number o£ cases above. 
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freshman writing performance ^s well as or better, than the Essay Pretest . 
TSiere would appear to be no systematic differences in the correlations 
for the different groups, with the slight differences in correlations 
probably resulting from sampling differences. 

Tables 15, 16, 17, and 18 are also useful foi; comparing alternate 
predictors such as high school performance. The correlation between 
high school rank and the Essay Posttest was ,30 for males, .37 for females, 
♦35 for majorities, and .05 for minorities. (In general, for minorities 
the high school rank seems to correlate lower with all other variables.) 
the correlation between high school English grade and Essay Posttest was 
.26 for males, .37 for females, .33 for majorities^ and .26 for minorities. 
These hJgh school data did not predict college performance as well as the 
TSWE sccres or SAT-V. scores (Variable 6) . Interestingly, the SAT-M score 
appears to have predicted college English performance better than high 
school data in some cases. 

Regression Analyses 

Given the objective essay criterion available for the 1975-76 data, 
it was oL particular interest to compare regressions of the essay on the 
TSWE scores for the four groups. Numerous such comparisons hay,e been 
made in past studies using course grades or CPA's as the criterion, but 
no previous studies have e^iployed an objective, blind-scored essay (that 
is, the scorers of the essays had never met the subjects who wrote the 
essays and they had no information concerning the subjects beyond the 
names, sex, ^hd -social security number written on the essays) . 

Figure 1 shcvs regression lines comparing males and females (top) 
and majorities and minorities (bottom) . Ihe male-female comparison 
suggests some real differences in the slopes of the regression lines 



A" 



\ ' Figure 1 

Comparison of Jlegpessions*^ of Essay Scores 
on TSWE Scores. foV Males, Females, Majorities, and Minorities 



12 



0) 

u 
o 

olo 

CO 

ii ^ 

U-l 

C V 



^ 



Male Female 
r ' .54\ .54 
Slope .:.104\ .127 
Intercept 2.34 \ 1.52 

p (slope) = .057 
p (intercept) .14$ 




Male (~ 
TSWE Essay 



-/- 



20 



N 

Mean 
S.D. 

Range 



462 
41.3 
10.9 
20-60 



462 
6.63 
2.11 
2-12 



I 



30 



- -40 
TSWE Score 



50 



-) T'emale ( — 
TSWE Essay 



342 
45.8 
"^•0.9 
20-60 



342 
7.33 
2.28 
2-12 



60 



12 ^ 



o 

■ u 

8 10 

>, 

w 
o 



o 2 



Slope 
Intercept 



^rity 
.51 
.104 
2.52 



Minority 
.49 
.105 
1*79 



p (slope) = .935 

p (intercept) = .001 



N 

Mean 
S.D. 

Range 



Majority(- 
TSWE Essay 

554 554 

45.6 7.25 

10.1 2.07 

20-60 2-12 



20 



30 



40 

TSWE Score 



-) Minor ity( ) 

TSWE Essay 



113 
33.8 
9.86 
20-59 



50 



113 
5.36 
2.10 
2-11 



60 
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(p » •057), but the difference in the y-intercept does not achieve 
significance. (Xliese statxstical tests were performed using an analysis 
of covariance procedure similar to that suggested by Gulliksen and Wilks , 
-1950.) - 

difference in slopes are clearly not statistically significant (p .935), 
and tHe lines appear to be parallel. On the other hand, the majority- 
minority differences in the y-intercept are statistically significant 
(p « .001) / ^ ^ , 

Interpretations of these regression comparisons iiia> be made as 
follows. If a single regression line were used for both males and 
females (rather than the separate regression lines shown in Figure 1), 
an under-pr edict ion would tend to occur for females in the high^ability 
range and an over-prediction in the low-ability range. That is, high- 
ability females performed slightly better on actual writing tests than 
the TSWE would have predicted with ^ single regression line. Conversely, 
low-ability females performed slightly worse on actual writing tests than 
a single regression line would have predicted. If 'a:; single regression 
line were used for both majority and minority students, an over-pr^ediction 
would occur for minorities at all ability levels. That is, minorities 
did not perform as well on actual writing tasks as the TSWE would have 
predicted with a single regression line. 

While some of th^.se group differences attain statistical signif- 
icance, it is doubtful whether they are of practical significance. 
Scatter-plots of the points through which the regression .lines were 
drawn, do not suggest important group differences in the relationship 
between TSWE scores and writing performance. 

-35- " . . 
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Discussion ' 

Neither the analyses of Part I nor those of Part II indicate that 
the TSWE is unfair to either women or minorities,. That is, ^ traditional 
correlational and regression analyses do not show any substantial 
differences among the relationships which operate to the disadvantage of 
women or minorities* Nevertheless, aese traditional analyses may leave 
'some important issues unexplored • For example, Goldman and Wida^ski (1976) 
suggest that it is necessary to go beyond hit/miss analyses (like those 
done in both Parts I and II) and to consider false-positive and fa^se- 
negative errors. False-positive errors occur when those predicted to 
succeed, fail> and false-negative errors occur when those'predicted to 
fall, succeed. The sum of false-positive errors and false-negative 
errors is the number of misses. Although the placement context in which 
the TSWE is used is not one of selection vs. rejection, it is still of 
importance to make accurate predictions. Therefora, it is appropriate 
to pay particular attention to false negatives; that is, those who were 
not "selected,** but who would have succeeded, had they l)een« 

In Part I, four-fold tables were developed and hit/miss ratios 
computed. Below, these same tables are presented with tt. "-oportions 
in each cell computed. Note that false-positives are those students in 
the upper-right hand quadrants and that false-negatives are students in 
the lower left-hand quadrants. The false-negative quadrants are shaded 
to emphasize their importance: 
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Males ^ 
(1,541) 



Females 
(1,859)- 







■A or B 


C,D,F 






A or B 


C,D,F 


• • 


TSWE 


40' 


510 
.33 


434 
.28 


TSWE 


40 


855 
.46 


442 ' 
.24 




"tswe 


40 

V 


yy///// 
> 174 / 

^ Ml / 
V////// 


423 
.27 


TSWE 


40 


y/J//// 
/ 193 / 


369 
.20 


: 






Majorities 
(2,082) 
A or' B C,D,F 






* 

, Minorities 
(667) ' 
A or 3 C,D,F 




TSWE 


AO 


929 
.45 


516 
.25 


TSWE 


' 40 


. 129 , 
.19' 


'107 
.16 




TSWE 


40 


/////// 

/ .11 / 
\/////// 


397 
.19 


TSWE 


40 


/////// 
9 114^ 

/ -17 7 

V/////V 


317 
.48 





For males, above, the sum of .28 (the proportion of false-positives) and 

.11 (the proportion of false-negatives*) is the proportion of "misses" 

(.39). The proportion of misses for each of the groups is: 

. ^ Proportion of Misses 

(Grades) 



mes 
Females 
Majorities 
Minorities 



.39 
.34 
.36 
.33 



In the Goldman and Widawski (1976) procedure, however, the concern is 
; not only with misses but with the type of miss. The logic is that a 
false-negative error is worse than a false-positive error. In the 
selection contc;;t, false-negatives would be denied an education (at a 
particular iistitution) even though they could have succeeded if they 
had been selected. In a 'placement situation, false-negatives might be 
placed in a slower section, even 'though they could have succeeded in a 
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faster section. From an institutional perspective and a placement situ- 
ation, both types of error are of equal importance and accordingly, -the 
analysis of misses is more important than an analysis of false-negatives. 
This distinction is an important one, for although minorities have the 
largest proportion of false-negatives (,17) they have the smallest 
proportion of misses (.33). 

Goldman and Widawski emphasize that the use of grades, as in Part 1^ 
may introduce biases. For this reason, it is of particular interest to 
compare the Part I analyses with the Part II analyses, where an objective 
criterion (essay writing performance) was used. Shown below are the four 
fold tables for^Part II with the proportions in each quadrant indicated: 



Males 

/ .:-(493) 
'-Essay Essay 
7 to 12 2 to 6 



Females 
(403)^ 
Essay Essay 
7 to 12 2 to 6 



1 

TSWE >. 40 ' 


.151 ' 
.30 


102 
.21 


TSWE > 40 


200 
.50 


101 
.25 


TSWE < 40 




204 
.41 


TSWE < 40 


^ .06 Z 


79 
.39 



^^ajorities 
(681) 
Essay» Essay , 
7 to 12- ' '^2 to 6 



' Minorities ' 
(115) • 
Essay Essay 
7 to 12 2 to 6 



.TSWE 1 40 


273 


122. 
. ,, .1& 


TSWE'"> 


40"' 


22 

.19 ' 


11 
.10 


TSWE <'4A. 




. 249 • ' 
'.36 


' , TSWE < 


40 




73 
.63 



VJhen an objective cr^jTteriOA- (a bliird-sTcored es^ay) is used, the 
greater ptopprtib^i of falsernefeatives for jJiinorities tends to disappear. 
The small differences that^ocfyir for the four groups ('.07, j.06, .05," .08) 



cojLild have occurred by ch\^nce, and — for all 'four groups — ^^the obs^erved 
proportion cf false-negatives is less than the observed, proportion of 
false-positives. As in the grade outcome comparisons, the prop'ortibn ^ 
of misses for minorities is less than the proportion of misses for any 
ol the other j^three <groups : 

Proportion of Misses 
(Essays) 

' Males " .28 '" 

Females ^ .31 

Majorities • .23 , ' 

Minorities " * • ^18 

In view X)f the dependence of the^e hit and miss analyses on the 
cutting score, regression analyses (which are independent of the cutting * . 
score) are in many ways preferable. Nevertheless, tlfe hit and miss procedure 
shows specf.f Ic outcomes when knowledge of the specific use of a test is knovm. 

The proportion of misses above was based^upon a^ cutting 3core of 
40 for all four groups. Since the proportion *of misses depends upon where 
the cutting score is set, it is of interest to compute the proportion of 
misses for aXl four 'groups at all possible cutting scores. Moreover, 
an analysis. can be done for both the grade outcomes of Part I and the 
essay outcomes pf Part II • . ' . 

The analysis of grade outcomes of Part I yielded the results shoVn 
in Table 19. Table 19 shows that to minimize the proportion of misses in ' 
course placement, a different cutting score would have been needed for 
males and £emales but the same cutting score would be used for majorities 
and minorities. The proportion of misses for males was minimized at a 
TSWE cutting score of 50, that for females at 40, and that for both 
majorities and minorities at 45. The differences in proportions of 
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Table 19. , " 

' Proportions of Misses Based on- Grade Outcomes 



. ^ TSWE 

Cutting Hales Females Majorities Minorities' 
Score (1,541) ^ . a,^59> (2,082) (667) ^ 



60 


.43 


.53 


• 


.54 


.36 


55 


.38 


146 




.48 


.34 


50 


..35" 


.37 




.40 


.33 


45 


\yi 


.35 




.35 


.32 


40 


.39 


. _ . 34 




.36 


.33 


35 


.46 


■ .35' 




.39 


.38 


30 


' .48 


.39 




•^2 


.45 


25 


.52 


.40 




.42 


.53 


20 


.56 


.44 




.44 


.64 



t 
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misses for males and females, however, are not substantial* The cutting 
score for males and females could I ^re been set at the 45 score optimum 
foi minorities without any important increase in proportions of misses 
for the other groups. 

The same kind of analysis for the essay outcomes of Part II are 
given in Table 20. In Table 20, a TSWE cutting .score of 45 minimized 
the proportions of misses for males, females, and majorities. The pro- 
portion of misses for minorities was minimized at a TSWE cutting score 
of 40, As for the course grade analyses, the outcome differences were 
not great in the^. minimum region. Consequently, a cutting score of 45 
for all groups would have been appropriate. 

No substantial differences in the optimum cutting scores were 
observed across groups for either the grade outcome data of Part II or 
the essay outcome data of Part II. Vfhen viewed in conjunction with the 
regression analyses of Figure 1, the hit and miss analyses strongly 
suggest that the use of TSWE in placement results in no unfairness to 
any of the four groups analyzed in this study. 



/ 



Table 20^ . 

• • • 

Proportions of Misses Based on Essay Outcomes 



TSWE , . ' 
Cutting Males Fenales Majorities Minorities 
Score (493) (403) , ' C681) (-115) 



60 




. .38 


•• .50- . - 


.42* 


.27 

* * 


55 




-.31 ' 


.38 " ^ 


.'33 


:25 


.50 




.26 


.27 


.24. ' 


.23 


45 




-.24 


. .21 


.21 


.21 


40 




.28 


^31 " ^ 


.23 


' .18 


35 




.33 


.35 


.27 


.27 


30 




.44 


.36 


.31 


.40 


25 




.53 


.41 


.35 


. .52 


20 




.62 


.45 


.54 


.73 



Summary and- Conclusions 

Dafa for the TSWE were' collected for two acad*emic years. 

t 

Fourteen institutions participated in the first year and Tour in the 
second. Within each of the years, data were pooled -and then subclassi- 
fied into four groups: males, females, majorities, and minorities. The 
groups *were then compared with respect to TSWE score distributions, 
correlations of TSWE 'scores with later performance in freshman English 
courses, regressions uf essay scores on TSWE scores, and course placement. 

Neither the correlational nor the regression analyses suggested any 
substantial diffierences in prediction among the grpups. Statistically 
significant differences were obtained, however, between the slopes of the 
regression lines for males and females and between the intercepts of the 
regression lines for majorities 'and minorities. The regression lines 
thus indicated that females scoring high on the TSWE tended to write 
better essays than males scoring high on the TS^'JE. Conversely, low- 
scoring females tended to write worse essays than low-scoring males. The 
majority and minority regression line comparisons indicated that, for the 
same TSWE score, majorities tende' to write better essays than minorities 
throughout the range of TSWE scores. Howe/er, these differences were not 
of sufficient size to be of any, practical significance. 

Analyses v/ere also made of hits, misses, false-positive errors, and 
false-negative .errors. False-positive errors occur when a high TSWE 
score is associated with either a low course grade or a low essay score. 
False-negative errors occur when a low TSWE score is associated with 
either a high course grade or a high essay score. Misses consist of the 



sum of false-positive and false-negative errors. These analyses were of 
interest for comparison with recent literature; howler, they suggested 
a lack of generalizability resulting from their dependence upon the cut- 
ting score. The correlational and regression analyses offered more 
generalizable results. 

Perhaps the most significant aspect of the study was the use of . 
an objective criterion (a graded essay score) for the comparison of 
predictive validities of the TSWE for the four groups. Much past 
research oi. predictive validity ^comparisons has been questioned on the 
grounds that course grades, a. subjective cr-'-teri'Ti, may be biased for or 
against females or fpr or against minorities. The use of a blind-scored 
essay greatly reduces possible biases because the professionals scoring 
the essays have no contact with nor knowledge of the students who wrote 
the essays. The study showed that when the possible biases were con- 
trolled by the blind-scoring procedure the results were quite similar 
to results that have been obtained with more subjective criteria such 
as course grades. - 

The study was limited* to some degree, of course, by the necessity 
of combining all minorities into one group. Future studies should 
attempt to focus on single groups. Therefore, sufficient quantities 
of data should be collected for within-group analysis. 
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